Terminal display control method, terminal display system and server apparatus

ABSTRACT

According to one embodiment, a terminal display control method for using as a controller of a game a terminal device including a touch panel, which is configured to be integral with a display, includes selecting a controller image which is used in the game; setting at least one of a presence/absence of a function, a number, a size, a shape and a position of disposition, with respect to an operation element in the controller image; and making variable, in accordance with a content of the setting, a state of the controller image displayed on the display, and an operation standard of the operation element corresponding to an input on the touch panel.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.14/167,290, filed on Jan. 29, 2014, which claims the benefit of priorityfrom Japanese Patent Application No. 2013-017770, filed on Jan. 31,2013, the entire contents of which are incorporated herein by reference.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates to a terminal display control method withuse of a smartphone, a tablet terminal, etc., a terminal display system,and a server apparatus.

2. Description of the Related Art

There has been developed a technique aiming at giving greater enjoymentto a plurality of players by enhancing the importance of audio inputs ofplayers, giving a sense of community among plural players, and giving afeeling of achievement by progressing a game with the cooperation ofplural players, or, to be more specific, a technique in which pluralcharacters on a game perform specific actions, which are different fromnormal actions, only when plural players utter speeches at substantiallythe same time (for example, Patent document 1).

CITATION LIST Patent Literature

Patent document 1: Jpn. Pat. Appln. KOKAI Publication No. 2003-135845

BRIEF SUMMARY OF THE INVENTION

Patent document 1 relates to a technique of a game program whichprogresses by causing a plurality of characters, which are displayed ona display screen, to perform desired actions by operations of differentplayers. An example, in which a home game machine and a controller forexclusive use in the game machine are used, is disclosed in thedescription of “Embodiment of the Invention” (paragraph [0017] onwards),and in the drawings (FIG. 1, etc.).

In the meantime, in recent years, mobile terminals called “smartphones”have been gaining in popularity, taking the place of conventional mobilephones called “feature phones”. The smartphone includes a touch panelwhich is formed integral with a relatively large display screen with adiagonal of about 4 inches or more, and has an upgraded datacommunication function.

In addition, there have been an increasing number of people who carrytablet-type personal computers (hereinafter referred to as “tabletterminals”) each having a large display screen with a diagonal of about10 inches or more and having a communication function, in order to meetthe need for a larger display screen than the smartphone.

The object of the present invention is to provide a terminal displaycontrol method, a terminal display system and a server apparatus, whichcan realize an environment in which a smartphone or a tablet terminal,which is possessed by a general user, can be effectively used, and agame can be easily enjoyed, with a personal habit in operation of eachuser being taken into account.

In general, according to one embodiment, a terminal display controlmethod for using as a controller of a game a terminal device including atouch panel, which is configured to be integral with a display, includesaccepting a controller image which is used in the game; setting at leastone of a presence/absence of a function, a number, a size, a shape and aposition of disposition, with respect to an operation element in thecontroller image; and making variable, in accordance with a content ofthe setting, a state of the controller image displayed on the display,and an operation standard of the operation element corresponding to aninput on the touch panel.

According to the present invention, it is possible to realize anenvironment in which a smartphone or a tablet terminal, which ispossessed by a general user, can be effectively used, and a game can beeasily enjoyed, with a personal habit in operation of each user beingtaken into account.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute apart of the specification, illustrate embodiments of the invention, andtogether with the general description given above and the detaileddescription of the embodiments given below, serve to explain theprinciples of the invention.

FIG. 1 is a view illustrating an example of an environment ofrealization of a game system according to a first embodiment of thepresent invention.

FIG. 2 is a block diagram illustrating a functional hardwareconfiguration of electronic circuits which are common to a tabletterminal and a smartphone in the embodiment.

FIG. 3 is a sequence chart illustrating process contents as a whole,from the start to the execution of a game between a master device and aslave device according to the embodiment.

FIG. 4 is a view illustrating a case in which two smartphones selectcontroller images of the same pattern in association with the tabletterminal according to the embodiment, and execute a game.

FIG. 5 is a view for describing examples of selection of buttons formoving a character in the embodiment, and respective operations.

FIG. 6 is a view for describing an operation of a button simulating ananalog stick for moving a character in the embodiment.

FIG. 7 is a view for describing a successive operation on twoneighboring buttons in the embodiment.

FIG. 8 is a view for describing a simultaneous operation on twoneighboring buttons in the embodiment.

FIG. 9 is a view for describing a first method and a second method forvariably setting a detection area of a simultaneous operation on twoneighboring buttons in the embodiment.

FIG. 10 is a view for describing a third method for variably setting adetection area of a simultaneous operation on two buttons in theembodiment.

FIG. 11 is a view for describing a method of disposing a button at anarbitrary position in the embodiment.

FIG. 12 is a view for describing a method of correcting of a buttonwhich has been disposed at an arbitrary position in the embodiment.

FIG. 13 is a view illustrating an example of an environment ofrealization of a game system according to a second embodiment of theinvention.

FIG. 14 is a sequence chart illustrating process contents as a wholeduring a game between a game server apparatus, a master device and aslave device in the embodiment.

FIG. 15 is a view illustrating a case in which two smartphonesalternately select a controller image in association with a tabletterminal in the embodiment, and execute a game.

DETAILED DESCRIPTION OF THE INVENTION First Embodiment

A game system according to a first embodiment of the present inventionwill now be described with reference to the accompanying drawings.

FIG. 1 is a view for describing an example of a system environmentaccording to the embodiment. In FIG. 1, a tablet terminal M, whichfunctions as a shared device, and a plurality of smartphones, forexample, four smartphones S1 to S4, which are operated by users, aremutually wirelessly connected by a Bluetooth™ technology which is anear-field wireless communication standard.

A game is executed by a system configuration including the tabletterminal M and smartphones S1 to S4. In this example, the tabletterminal M functions as a master device which becomes a “parent” in thecourse of game progress. The tablet terminal M executes the progress ofthe game and the display of the game image in association withoperations in the respective smartphones S1 to S4.

The tablet terminal M should desirably have a larger display screen thanthe smartphones S1 to S4, but the tablet terminal M may be a mobileterminal having the same configuration as the smartphones S1 to S4.

On the other hand, each of the smartphones S1 to S4 is a slave devicewhich becomes a “child”, and functions as a game controller which isoperated by each user. Each smartphone, S1 to S4, displays an image ofthe game controller on its display, and transmits, upon accepting a useroperation by an operation on the touch panel, a corresponding operationsignal to the tablet terminal M.

FIG. 2 is a block diagram illustrating a functional hardwareconfiguration of electronic circuits which are common to the tabletterminal M and smartphones S1 to S4. In FIG. 2, a CPU 11 executes acontrol operation of the entirety of the tablet terminal M (orsmartphone, S1 to S4). A main memory 12, a solid-state drive (SSD) 13, a3G & 4G communication unit 14, a wireless LAN communication unit 15, anear-field wireless communication unit 16, an external memory card 17, adisplay 18, a touch panel input unit 19, a key input unit 20, an audioprocessor 21, an image processor 22, a 3-axis acceleration sensor 23,and a vibrator 24 are connected to the CPU 11 via a system bus SB.

The CPU 11 reads out operation programs (an OS and an applicationprogram running on the OS) stored in the solid-state drive 13 androutine data, develops and loads them in the main memory 12, andexecutes the programs, thereby comprehensively controlling the entireoperation of the tablet terminal M (or smartphone, S1 to S4).

The main memory 12 is composed of, for example, an SRAM, and functionsas a work memory of the CPU 11. The solid-state drive 13 is composed ofa nonvolatile memory, for instance, a flash memory, and stores, as astorage medium of the tablet terminal M (or smartphone, S1 to S4),various contents such as image data and song data, as well as theabove-described operation programs and various routine data.

The 3G & 4G communication unit 14 is a communication unit which operatesin a dual mode, and transmits/receives data to/from a nearby basestation (not shown) via an antenna 25, based on a third-generationmobile communication system according to the IMT-2000 standard, and afourth-generation mobile communication system according to theIMT-Advance standard.

The wireless LAN communication unit 15 transmits/receives data to/from anearby access point (not shown) or the like via an antenna 26, based on,for example, the IEEE802.11a/b/g/n standard.

The near-field wireless communication unit 16 transmits/receives datato/from some other Bluetooth™ standard device within a range of, e.g.Class 2 (within a radius of about 10 m).

The external memory card 17 is a medium for expanding the storagecapacity of the solid-state drive 13. The external memory card 17 isdetachably attached by a user of the tablet terminal M (or smartphone,S1 to S4).

The display 18 is composed of a backlight-equipped TFT color liquidcrystal panel, and a driving unit thereof. The display 18 displaysvarious images.

The touch panel input unit 19 is configured to be integral with thedisplay 18 by using a transparent electrode. The touch panel input unit19 generates and outputs two-dimensional position coordinate informationwhich corresponds to a touch operation by the user.

The key input unit 20 is composed of some key switches including a powerkey and a shutter key of a camera function, which are provided on theouter surface of the casing of the tablet terminal M (or smartphone, S1to S4), and a driving circuit of these key switches.

The audio processor 21 converts digital audio data, which is deliveredvia the system bus SB, to an analog audio signal, and outputs the analogaudio signal from a speaker 28. In addition, the audio processor 21samples an analog audio signal, which is input from a microphone 29,converts the analog audio signal to digital data and outputs the digitaldata.

The image processor 22 converts to digital data an image signal which isoutput from a solid-state imaging device 31 in accordance with anoptical image which is focused on an imaging surface of the solid-stateimaging device 31 via an optical lens system 30. The solid-state imagingdevice 31 is composed of, for example, a CCD (Charge Coupled Device) ora CMOS image sensor. The image processor 22 creates and outputs filedata which is compressed in data amount by a preset file format, forexample, by JPEG (Joint Photographic Experts Group) in the case of astill image.

Next, an operation of the first embodiment is described.

The operation to be described below is executed after the CPU 11 in eachof the tablet terminal M and smartphones S1 to S4 has read out theoperation programs stored in the solid-state drive 13, as describedabove, and has developed and loaded the operation programs in the mainmemory 12. The operation programs stored in the solid-state drive 13 arenot limited to programs which were stored in the solid-state drive 13 ata time of factory shipment of the tablet terminal M (or smartphone, S1to S4), and may be programs which are input from the outside by the userof the tablet terminal M (or smartphone, S1 to S4) via the antenna 25and 3G & 4G communication unit 14, or the antenna 26 and wireless LANcommunication unit 15.

FIG. 3 is a sequence chart illustrating process contents as a whole,from the start to the execution of a game between the tablet terminal Mthat is a master device and the smartphone, S1 to S4, that is a slavedevice.

To begin with, a pairing process based on the Bluetooth™ standard isexecuted between the tablet terminal M and the smartphone, S1 to S4,thereby establishing a wireless connection state between the tabletterminal M functioning as the master device and the smartphone, S1 toS4, functioning as the slave device (step M101, S101). It is assumedthat this pairing process, if once executed between the tablet terminalM and the smartphone, S1 to S4, can be omitted when the game is to beexecuted at the second and following times.

Thereafter, the tablet terminal M starts an application program for themaster device of the associated game (step M102). On the other hand,each of the smartphones S1 to S4 starts an application program for theslave device of the associated game (step M102).

A controller image, which is used in the game, is designated from thetablet terminal M to the smartphone, S1 to S4 (step M103). As regardsthe designation of the controller image, it is possible to designatechoices of plural patterns of the controller image if these patternsinclude operation elements such as buttons and analog sticks necessaryfor the game, so that the user can select an arbitrary controller imageon the side of the smartphone, S1 to S4.

Each of the smartphones S1 to S4 chooses an arbitrary one among pluralcontroller images, where necessary, and executes setup of the controllerin accordance with an operation on the touch panel input unit 19 (stepS103).

FIG. 4 illustrates an example of the case in which smartphones S1 and S2select controller images of the same pattern in association with thetablet terminal M, and execute a game. In this game, the display 18 ofthe tablet terminal M displays a character C1 which operates by anoperation on the smartphone S1, and a character C2 which operates by anoperation on the smartphone S2, and these characters C1 and C2 are movedso that either of them may finish the goal line earlier.

In this case, in the controller image displayed on the smartphone S1,S2, it is assumed that the start and end of the game, the operation ofthe speed of movement, the obstruction to the other character, etc. canbe executed by operations of buttons indicated by “1” to “8”, and thebasic direction of movement of the character is operated by an operationof, for example, a cross (+) key “9”.

In addition, two operation elements ASL and ASR, which simulate analogsticks on the lower side of the screen, are not used in this game andare indicated by broken lines.

After the setup of the controller image in step S103, the CPU 11 of thesmartphone, S1 to S4, determines customization setup by an arbitraryselection by the user. Specifically, the CPU 11 determines whether ornot to make variable, and set, at least one of a presence/absence of afunction, a number, a size, a shape and a position of disposition, withrespect to an operation element in the controller image, based on anoperation on the touch panel input unit 19 (step S104).

If the user has executed an associated operation in order to customizethe controller image, the CPU 11 executes, upon receiving thisoperation, a necessary customization process (step S105). Concretevarious customization processes will be described later in detail.

After executing the customization process in accordance with the user'soption, the smartphone, S1 to S4, notifies the tablet terminal M thatthe game is ready to start, in accordance with a user operation (stepS106).

The tablet terminal M stands by for the notification that the game isready to start, from all the smartphones S1 to S4 which have establishedthe connection state by the pairing process in step M101 (step M104).After confirming all the notifications, the tablet terminal M notifiesthe start of the game to the smartphones S1 to S4 (step M105).

After designating the start of the game, the tablet terminal M executesa game progress process and updates the display on the display device 18(step M106), and transmits to the smartphones S1 to S4, where necessary,the information about images which are to be displayed on the game onthe smartphones S1 to S4 that display the controller images, forexample, the information about images of operation buttons which aretemporarily enabled or scores (step M107).

Further, the tablet terminal M determines whether an operation signalfrom any one of the smartphones S1 to S4 has been received (step M108).If it is determined that the operation signal has been received, thetablet terminal M executes a reception process of the received operationsignal (step M109), and returns to the process from M106 so as totransition to the next game development by utilizing the receivedoperation signal where necessary.

In this manner, the tablet terminal M repeatedly executes the process ofthe above steps M106 to M109, thereby continuing to control the progressof the game while accepting operation signals from the smartphones S1 toS4.

On the other hand, after notifying the tablet terminal M in step S106that the game is ready to start, the smartphones S1 to S4 start the gameupon receiving the notification of the start of the game from the tabletterminal M which has responded to the notification by the smartphones S1to S4 (step S107).

Each of the smartphones S1 to S4 determines whether an image for anoperation, for instance, which is sent from the tablet terminal M, hasbeen received (step S108). If the image for an operation has beenreceived, the smartphone, S1 to S4, executes a process of, for example,reflecting the display of the controller image on the display 18, basedon the received information (step S109).

Furthermore, each of the smartphones S1 to S4 determines whether anoperation has been executed in accordance with an operation signal fromthe touch panel input unit 19 (step S110). If it is determined that theoperation has been executed, the smartphone, S1 to S4, generates anoperation signal corresponding to this operation, and transmits theoperation signal to the tablet terminal M (step S111).

In addition, the smartphone, S1 to S4, returns to the process from stepS108, after executing correction setup on operation elements such as theoperated buttons, based on the contents of the operations determined instep S110 and the operation history thus far.

In this manner, by repeatedly executing the process of steps S108 toS112 hereafter, the smartphone, S1 to S4, continues the game byaccepting the user's input operation on the controller image, and alsocontinues the correction process on the operation elements such as thebuttons, analog sticks, etc. displayed on the display 18.

In the meantime, it is assumed that the customization process on anarbitrary game controller by the user in step S105 may be executed notonly before the start of the game, but also during the game after thestart of the game.

Next, a description will be given of some concrete examples of theabove-described customization process of the game controller and thecorrection process.

FIG. 5 is a view for describing a controller image including a buttonwhich may be selected by a customization process by the user of thesmartphone, S1 to S4, and an operation of moving a character inaccordance with a button operation.

Parts (A-1) and (A-2) of FIG. 5 illustrate an example in which acontroller image including a button B11, which is generally called“cross key” and instructs a movement in one of four directions by onebutton, has been selected in a customization process in a smartphone Sn(n: any one of 1 to 4). Parts (A-1) and (A-2) of FIG. 5 show, by way ofexample, states of movement of a character Cn (n: any one of 1 to 4)which is displayed on the tablet terminal M in accordance with anoperation of the button B11, when this operation has been executed. Part(A-1) of FIG. 5 illustrates a state in which the user executes apressing operation on a “right” side of the button B11, as indicated byan arrow A11, and thereby the associated character Cn moves to the“right” side on the display 18 of the tablet terminal M.

Thereafter, as shown in part (A-2) of FIG. 5, the user releases thepressing operation on the “right” side of the button B11, as indicatedby an arrow A12. Thereby, on the display 18 of the tablet terminal M,the corresponding character Cn stops the movement to the “right” side.

Part (B) of FIG. 5 illustrates a case in which a controller imageincluding a button B12, which instructs a movement in any one of eightdirections by one button, has been selected in the smartphone Sn (n: anyone of 1 to 4), and the button B12 has been operated, and part (B) ofFIG. 5 shows, by way of example, a state of movement of the character Cn(n: any one of 1 to 4) which is displayed on the tablet terminal M inaccordance with the operation of the button B12.

Part (B) of FIG. 5 illustrates a state in which the user executes apressing operation on a “lower right” side of the button B12, asindicated by an arrow A12, and thereby the associated character Cn movesto the “lower right” side on the display 18 of the tablet terminal M.

Part (C) of FIG. 5 illustrates a case in which a controller imageincluding a button B13, which instructs a movement in any one of fourdirections by four independent buttons, has been selected in thesmartphone Sn (n: any one of 1 to 4), and this button B13 has beenoperated, and part (C) of FIG. 5 shows, by way of example, a state ofmovement of the character Cn (n: any one of 1 to 4) which is displayedon the tablet terminal M in accordance with this operation of the buttonB13.

Part (C) of FIG. 5 illustrates a state in which the user executes apressing operation on a “right” side of the button B13, as indicated byan arrow A13, and thereby the associated character Cn moves to the“right” side on the display 18 of the tablet terminal M.

FIG. 6 is a view for describing a controller image including a buttonsimulating an analog stick which may be selected by a customizationprocess by the user of the smartphone, S1 to S4, and an operation ofmoving a character in accordance with a button operation.

In this example, a button simulating an analog stick is expressed as abutton image B21 having a shape of two concentric circles (in a state inwhich no operation is executed). An inner circle of the button image B21is indicative of an operation element, and an outer circle is indicativeof an operation range. The button image B21 is displayed such that theposition of the inner circle moves in accordance with a touch positionby slide-operating and moving the inner circle in an arbitrary directionwhile touch-operating the inner circle within the range of the outercircle. By detecting the movement direction and movement amount of thetouch operation on the button image B21, it becomes possible to displaythe character Cn in a manner to arbitrarily move in any direction overthe range of 3600 in a stepless manner, in accordance with the movementspeed of the touch operation.

Specifically, as shown in part (A) of FIG. 6, the user performs a touchoperation within the inner circle of the button B21 by the smartphone Sn(n: any one of 1 to 4), as indicated by an arrow A21, and performs,while keeping the touch state, a slide operation to an “upper right”side, as indicated by an arrow A22 in part (B) of FIG. 6. Thereby, acoordinate value “+3, +2” indicative of the operation direction isdetected by the touch panel input unit 19. In the tablet terminal M, thedisplay 18 displays the character Cn in a manner to move in the “upperright” direction in accordance with the coordinate value.

Further, from the state in which the touch operation of the inner circleof the button B21 is performed as shown in part (B) of FIG. 6, a slideoperation of the inner circle is performed to a “lower left” side, asindicated by an arrow A23 in part (C) of FIG. 6. Thereby, a coordinatevalue “−5, −5” indicative of the operation direction is detected by thetouch panel input unit 19. In the tablet terminal M, the display 18displays the character Cn in a manner to move in the “lower left”direction in accordance with this coordinate value.

Thereafter, as shown in part (D) of FIG. 6, if the touch operation ofthe inner circle of the button B21 by the user is released as indicatedby an arrow A24, the tablet terminal M stops the movement of thecharacter Cn to the “lower left” side on the display 18.

FIG. 7 is a view for describing a successive operation on twoneighboring buttons in the controller image, which may be selected bythe user of the smartphone, S1 to S4, in the customization process.

In this case, at the time of customization setup, the display 18 iscaused to display, for example, a guide message “when successive keysare set up, execute an operation across the ‘α’ button and ‘β’ button ata time”, and an image of an operation example. The smartphone, S1 to S4,accepts the operation across the “α” button and “β” button, and therebythe successive keys can be set up.

In this example, two windows W11 and W12 are displayed in a game imageon the display 18 of the tablet terminal M, and two neighboring buttonsB31 and B32 are displayed on the smartphone Sn (n: any one of 1 to 4). Adescription is given of the case in which an item “α” is temporarilydisplayed in the window W11 when the button B31 has been touch-operated,and an item “β” is temporarily displayed in the window W12 when thebutton B32 has been touch-operated.

Specifically, as shown in part (A) of FIG. 7, the user touch-operates,as indicated by an arrow A31, an outside area on the left side of thebutton B31 which is the left-side one of the two neighboring buttons B31and B32 of the smartphone Sn. While keeping the touch state, the userperforms a slide operation to the “right” side, as indicated by an arrowA32 in part (B) of FIG. 7.

In part (C) of FIG. 7, at a time when the touch position has entered thearea of the button B31, as indicated by an arrow A33, the touch panelinput unit 19 detects this state, and a corresponding operation signalis transmitted from the smartphone Sn to the tablet terminal M. Thereby,on the tablet terminal M, the item “α” is caused to appear in the windowW11.

Thereafter, as shown in part (D) of FIG. 7, if the touch position hasmoved out of the button B31 by a further slide operation as indicated byan arrow A34, the touch panel input unit 19 detects that the touchoperation on the button B21 has been released, and the transmission ofthe operation signal from the smartphone Sn to the tablet terminal M isstopped. In the tablet terminal M, the display of the item “α” in thewindow W11 is turned off.

In part (E) of FIG. 7, at a time when the touch position has entered thearea of the button B32 by a further slide operation, as indicated by anarrow A35, the touch panel input unit 19 detects this state, and acorresponding operation signal is transmitted from the smartphone Sn tothe tablet terminal M. Thereby, on the tablet terminal M, the item “β”is caused to appear in the window W12.

In part (F) of FIG. 7, if the user has released the finger from thetouch panel input unit 19, as indicated by an arrow A36, the touch panelinput unit 19 detects that there is no longer the touch operation on thebutton B32, and the transmission of the operation signal from thesmartphone Sn to the tablet terminal M is stopped. In the tabletterminal M, the display of the item “β” in the window W12 is turned off.

FIG. 8 is a view for describing a simultaneous operation on twoneighboring buttons in the controller image, which may be selected bythe user of the smartphone, S1 to S4, in the customization process.

In this case, at the time of customization setup, the display 18 iscaused to display, for example, a guide message, “When simultaneous keysare set up, execute an operation across two buttons that are to be set”,and an image of an operation example. The smartphone, S1 to S4, acceptsthe operation across the “α” button and “β” button, and thereby thesimultaneous keys can be set up.

In this example, two windows W21 and W22 are displayed in a game imageon the display 18 of the tablet terminal M, and two neighboring buttonsB41 and B42 are displayed on the smartphone Sn (n: any one of 1 to 4). Adescription is given of the case in which, when an overlap areaincluding an area between the buttons B41 and B42 has beentouch-operated, an item “α” is displayed in the window W21 correspondingto the button B41, and at the same time an item “β” is displayed in thewindow W22 corresponding to the button B42.

Specifically, in part (A) of FIG. 8, the user touch-operates, asindicated by an arrow A41, an outside area on the left side of thebutton B41 which is the left-side one of the two neighboring buttons B41and B42 of the smartphone Sn. While keeping the touch state, the userperforms a slide operation to the right side, as indicated by an arrowA42 in part (B) of FIG. 8.

In part (C) of FIG. 8, at a time when the touch position has entered thearea of the button B41, as indicated by an arrow A43, the touch panelinput unit 19 detects this state, and a corresponding operation signalis transmitted from the smartphone Sn to the tablet terminal M. Thereby,on the tablet terminal M, the item “α” is caused to appear in the windowW21.

Thereafter, as shown in part (D) of FIG. 8, if the touch position hasentered an area AR11, which includes an area between the button B41 andbutton B42 and spans between the button B41 and button B42, by a furtherslide operation as indicated by an arrow A44, the touch panel input unit19 detects that the area corresponding to the two buttons has beenoperated, and an operation signal is transmitted from the smartphone Snto the tablet terminal M. Upon receiving this operation signal, thetablet terminal M simultaneously displays the item “β” in the windowW22, in addition to the display of the item “α” in the window W21.

In part (E) of FIG. 8, at a time when the touch position has moved outof the area AR11 spanning between both buttons by a further slideoperation and has entered the area of only the next button B42, asindicated by an arrow A45, the touch panel input unit 19 detects thisstate, and a corresponding operation signal is transmitted from thesmartphone Sn to the tablet terminal M. Thereby, on the tablet terminalM, the display of the item “α” in the window W21 is turned off, and onlythe item “β” is displayed in the window W22.

In part (F) of FIG. 8, if the user has released the finger from thetouch panel input unit 19, as indicated by an arrow A46, the touch panelinput unit 19 detects that there is no longer the touch operation on thebutton B42, and the transmission of the operation signal from thesmartphone Sn to the tablet terminal M is stopped. In the tabletterminal M, the display of the item “β” in the window W22 is turned off.

FIG. 9 is a view for describing a first method and a second method forvariably setting a detection area of a simultaneous operation on twoneighboring buttons in a controller image, these methods being executedby the user of the smartphone, S1 to S4, in the customization process.

It is now assumed that two buttons B51 and B52 are displayed adjacent toeach other with a proper gap on the display 18 of the smartphone Sn (n:any one of 1 to 4), that an overlap area AR21, which includes this gapand spans between both buttons, is displayed by a broken line, and thatan “Edit” button B50 is displayed on an upper left end side of thescreen.

In part (A) of FIG. 9, if the user touch-operates the “Edit” button B50,as indicated by an arrow A51, the smartphone Sn switches the “Edit”button B50 to a “Save” button B53, and transitions into an edit mode.

In part (B) of FIG. 9, if a pinch-out operation of the overlap area AR21is performed in the edit mode by the user by two fingers, as indicatedby an arrow A52, the smartphone Sn enlarges the overlap area AR21.

Further, in part (C) of FIG. 9, if the two fingers are rotatedcounterclockwise, as indicated by arrows A53 and A53′, from the state ofthe pinch-out operation, the smartphone Sn can incline and set theenlarged overlap area AR21 in accordance with the rotational angle.

Thereafter, in part (D) of FIG. 9, if the user releases the fingers fromthe touch panel input unit 19, as indicated by an arrow A54, at a timepoint when the user has determined that the size, shape and inclinationof the overlap area AR21 are set in a desired state, the smartphone Sncan set the overlap area AR21 in a provisional state.

In part (E) of FIG. 9, if the “Save” button B53 is touch-operated inthis state, as indicated by an arrow A55, the smartphone Sn sets theoverlap area AR21 at this time point as a finally determined overlaparea.

As regards the overlap area AR21 for determining a simultaneousoperation of the buttons B51 and B52, by executing this customizationsetup, the personal habit in operation of the user can be taken intoaccount. For example, the shape of the overlap area AR21 can easily bemade adaptive to such a case that a drawing operation is performed in aflipping manner from the lower left to the upper right. Thus, theoperability for the user is enhanced.

In addition, a description is given of a setup method of another overlaparea AR22, which is different from the method of parts (B) to (E) ofFIG. 9.

From the state described in part (A) of FIG. 9, if the usertouch-operates the “Edit” button B50, as indicated by an arrow A51, thesmartphone Sn switches the “Edit” button B50 to a “Save” button B53, andtransitions into an edit mode.

In this case, as shown in part (F) of FIG. 9, a touch operation by afinger of the user is performed so as to surround a gap between thebuttons B51 and B52 on the touch panel input unit 19. In the smartphoneSn, in accordance with the touch operation, a closed figure, asindicated by an arrow D11, is drawn on the touch panel input unit 19.

In accordance with this operation, as shown in part (G) of FIG. 9, thesmartphone Sn sets the overlap area AR22 in a provisional state. If the“Save” button B53 is touch-operated by the user, the overlap area AR22at this time point is finally determined, and the overlap area AR22 isset.

By executing setup by the customization based on the drawing operation,the overlap area AR22 for determining the simultaneous operation of thebuttons B51 and B52 can be set more easily.

FIG. 10 is a view for describing a third method for variably setting adetection area of a simultaneous operation on two neighboring buttons ina controller image, the method being executed by the user of thesmartphone, S1 to S4, in the customization process.

In this method, two buttons B61 and B62 are displayed adjacent to eachother with a proper gap on the display 18 of the smartphone Sn (n: anyone of 1 to 4), that a “Start” button B60 is displayed on an upper leftend side of the screen, and that a guide message GM11, “Try X times”, isdisplayed on a lower end side of the screen. The guide message GM11gives an instruction to try point-position designation of a detectionarea, and designates the number of times of try.

In part (A) of FIG. 10, if the user touch-operates the “Start” buttonB60, as indicated by an arrow A61, the smartphone Sn switches the“Start” button B60 to a “Cancel” button B63, and starts a trial ofpoint-position designation.

As shown in part (B) of FIG. 10, if point positions are successivelytouch-operated by the user by the number of times designated, so as todesignate the above-described overlap area, the smartphone Snsuccessively displays the touch-operated positions on the display 18.

Then, as shown in part (C) of FIG. 10, at a time point when the touchoperation by the designated number of times has been completed, thesmartphone Sn sets an overlap area AR31, which includes the touchpositions of the designated number of times, in a provisional state, anddisplays the overlap area AR31 on the display 18.

At this time, the smartphone Sn displays, on an upper end part of thescreen of the display 18, a “Yes” button B64 for finally determining theoverlap area AR31 and a “Retry” button B65 for retrying the setup, inaddition to the “Cancel” button B63, and also displays, on a lower endpart of the screen, a guide message GM12, “Is this OK?”, which promptsthe user to select any one of the buttons.

If the “Retry” button B65 is touch-operated in this display state, asindicated by an arrow A63, the smartphone Sn restores to the state,shown in part (B) of FIG. 10, for accepting the designation of pointpositions.

On the other hand, if the “Yes” button B64 is touch-operated, asindicated by an arrow A62, the smartphone Sn sets the overlap area AR31,as shown in part (D) of FIG. 10, by deeming that the overlap area AR31at that time point has been finally determined.

By the point-position designation of the predetermined number of times,the overlap area AR31 for determining the simultaneous operation of thebuttons B61 and B62, which is optimal for each user, can easily be set.

FIG. 11 is a view for describing a method of disposing a button at anarbitrary position in a controller image, the method being executed bythe user of the smartphone, S1 to S4, in the customization process.

As shown in part (A) of FIG. 11, in the smartphone Sn (n: any one of 1to 4), it is assumed that an arbitrary position has been touch-operatedby the user's finger, as indicated by an arrow A71, on the display 18which displays no image.

As illustrated in part (B) of FIG. 11, the smartphone Sn detects thetouch-operated position from the touch panel input unit 19, and disposesand displays a button B71 at a corresponding position on the display 18.The case is now illustrated that a button simulating an analog stick isdisposed as the button that is to be disposed.

The button B71 simulating the analog stick is expressed as a buttonimage B71 having a shape of two concentric circles (in a state in whichno operation is executed). In this case, an inner circle of the buttonimage B71 is indicative of an operation element, and an outer circle isindicative of an operation range. The button image B71 is displayed suchthat the inner circle is slide-operated and moved in an arbitrarydirection within the range of the outer circle, while the inner circleis being touch-operated, and thereby the position of the inner circlemoves in accordance with the touch position. By detecting the movementdirection and movement amount of the touch operation on the button imageB71, it becomes possible to arbitrarily move the character Cn in anydirection over the range of 3600 in a stepless manner, in accordancewith the movement speed of the touch operation.

Specifically, as shown in part (C) of FIG. 11, the user performs a touchoperation within the inner circle of the button B71 by the smartphoneSn, as indicated by an arrow A72, and performs, while keeping the touchstate, a slide operation to a “left” side. Thereby, the inner circle ismoved and displayed within the range of the outer circle in accordancewith the operation position, and the operation signal is transmitted tothe tablet terminal M. In the tablet terminal M, the correspondingcharacter Cn is moved on the display 18 in the “left” direction inaccordance with the operation direction.

Thereafter, as shown in part (D) of FIG. 11, if the user releases thefinger from the display 18, as indicated by an arrow A73, the smartphoneSn turns off the display of the button image B71 from the display 18 inaccordance with the detection by the touch panel input unit 19.

In this manner, as well as the button B71 simulating the analog stick,another button or switch may be disposed and set at an arbitraryposition in the screen of the display 18. Thereby, a controller withhigh operability matching with the preference of the user can berealized.

FIG. 12 is a view for describing a method of correcting of the positionof a button, in a case of operating the button as a controller at a timewhen the user of the smartphone, S1 to S4, actually executes a game.

In part (A) of FIG. 12, in the smartphone Sn (n: any one of 1 to 4), itis assumed that, when a game is executed, an arbitrary position has beentouch-operated by the user's finger on the display 18 which displays noimage, as indicated by an arrow A71.

As illustrated in part (B) of FIG. 12, the smartphone Sn detects thetouch-operated position from the touch panel input unit 19, and disposesand displays a button B81, which simulates an analog stick, at acorresponding position on the display 18.

The button B81 simulating the analog stick is expressed as a buttonimage having a shape of two concentric circles (in a state in which nooperation is executed). In this case, an inner circle of the buttonimage B81 is indicative of an operation element, and an outer circle isindicative of an operation range. The button image B81 is displayed suchthat the inner circle is slide-operated and moved in an arbitrarydirection within the range of the outer circle, while the inner circleis being touch-operated, and thereby the position of the inner circlemoves in accordance with the touch position. By detecting the movementdirection and movement amount of the touch operation on the button imageB81, it becomes possible to arbitrarily move the character Cn in anydirection over the range of 3600 in a stepless manner, in accordancewith the movement speed of the touch operation.

In the case of the button image B81 shown in part (B) of FIG. 12, theposition of the user's touch operation is at a right side end portion ofthe display 18. Thus, the inner circle and outer circle of the buttonimage B81 cannot be displayed in a concentric shape in accordance withthe position of the touch operation. In this case, from the start ofdisplay, the smartphone Sn displays the button image B81 in the state inwhich the inner circle is moved to the right side within the outercircle of the button image B81, and transmits the associated operationsignal to the tablet terminal M. In the tablet terminal M, the characterCn is moved on the display 18 in the “right” direction in accordancewith the operation direction.

Thereafter, as shown in part (C) of FIG. 12, if the user has executed anoperation of releasing the finger from the touch panel input unit 19 ina direction indicated by an arrow A82, the smartphone Sn stops thedisplay of the button B81 and stops the transmission of the operationsignal to the tablet terminal M, since the touch operation on the touchpanel input unit 19 stops. Accordingly, the tablet terminal M stops themovement of the character Cn displayed on the display 18.

Subsequently, in part (D) of FIG. 12, if the user has touch-operatedonce again the right side end portion of the touch panel input unit 19by the finger, as indicated by an arrow A83, the smartphone Sn displaysonce again the button image 81 in the state in which the inner circle ismoved to the right side within the outer circle, and transmits theassociated operation signal to the tablet terminal M. In the tabletterminal M, the character Cn is moved once again on the display 18 inthe “right” direction.

In this manner, even when the user of the smartphone Sn has executedsuch an operation as to deviate from the display 18 and touch panelinput unit 19, while operating the smartphone Sn which displays thecontroller image, the display range of the button image B81 is limitedin advance within the display range of the display 18, so that thebutton image B81 may never be displayed outside the screen of thedisplay 18. Thus, at a time point when the operation by the user hasbeen restored, the immediately prior operation state is reproduced andthe game is continued. Therefore, the operability in the course of thegame is not degraded, and an operational error by the user can surely becorrected.

In addition, while the user is progressing the game, there are manycases in which the user operates various operation buttons whosepositions were set by the user, without viewing the controller imagethat is displayed on the display 18 of the smartphone Sn (n: any one of1 to 4).

Thus, it may be thought that an operation is often executed outside therange of the button, that is, outside the display 18 or touch panelinput unit 19, as described above. However, as illustrated in FIG. 12,by newly moving the button image to the detected operation position ofthe user, the operability of the touch panel input unit 19 can besecured.

In the above-described embodiment, as illustrated in FIG. 3, theselection and setup of the controller image are executed before thestart of the game by the customization process. However, in thedescriptions including descriptions of FIG. 4 to FIG. 11, thecustomization process of the selection and setup of the entire controlimage and the selection and setup of respective buttons, etc., whichconstitutes the controller image, may be executed at a proper timeduring the execution of the game.

As has been described above in detail, according to the embodiment, itis possible to realize an environment in which a smartphone or a tabletterminal, which is possessed by a general user, can be effectively used,and a game can be easily enjoyed, with a personal habit in operation ofeach user being taken into account.

In addition, in the embodiment, as described with reference to FIG. 7, asingle drawing operation on a plurality of buttons, which are aplurality of neighboring operation elements, can be set as a successiveoperation of the plural buttons. It is thus possible to realize anoperation by the controller with higher operability, taking the user'sdemand into account.

In the embodiment, as described with reference to FIG. 8, an operationon a range including an area between a plurality of buttons, which are aplurality of neighboring operation elements, can be set as asimultaneous operation of the plural buttons. It is thus possible torealize an operation by the controller with higher operability, takingthe user's demand into account.

Furthermore, in the embodiment, as described with reference to FIG. 9,the range for determining the simultaneous operation can be arbitrarilyset by the user himself/herself. It is thus possible to realize anoperation by the controller with higher operability, reflecting theuser's demand in executing the game.

In addition, in the embodiment, as described with reference to FIG. 10,the range for determining the simultaneous operation can be set based onthe tendency in operation of the user. It is thus possible to realize anoperation by the controller with higher operability, which is suited toeach user in executing the game.

In the embodiment, as described with reference to FIG. 11, the positionof the button simulating the analog stick, for which each user'spreference, in particular, tends to occur, can arbitrarily be set by theuser. It is thus possible to realize an operation by the controller withhigher operability, taking the user's demand into account.

Although not described in the above embodiment, for example, in the casewhere the user executes an operation without viewing the controllerimage displayed on the display 18 of the smartphone Sn (n: any one of 1to 4) in the course of operating the button simulating the analog stickhaving the position set by the user, it is thought that an operation isoften executed outside the range of the button. Thus, the CPU 11 maydetect the amount and direction of a displacement of the operationposition, based on the output from the touch panel input unit 19, and tomove and correct the position of the button simulating the analog stick,based on the detected amount and direction of displacement of theoperation position.

Thereby, even when the user has mistaken an operation position of thebutton simulating the analog stick, without being aware of the mistake,it is possible to continue the game without uselessly interrupting thegame or suffering a disadvantage in the game.

Besides, in the embodiment, as described with reference to FIG. 12, theoperation position of the button simulating the analog stick is limitedwithin the screen of the display 18. It is thus possible to avoid anoperation error of the user, without degrading the operability of anoperation on, in particular, a peripheral end portion of the touch panelinput unit 19.

Although not described in the above embodiment, the condition ofprogress of the game may be associated with the condition forcustomization setup, for example, such that a specific customizationprocess cannot be executed depending on the condition of progress of thegame, for example, unless a specific item is obtained. Thereby, thecapabilities of the game are enhanced and various game environments canbe provided.

Second Embodiment

A game system according to a second embodiment of the present inventionwill now be described with reference to the accompanying drawings.

FIG. 13 is a view for describing an example of a system environmentaccording to the embodiment. In FIG. 13, a game is executed by astructure including a tablet terminal M, which functions as a shareddevice, and a plurality of smartphones, for example, four smartphones S1to S4, which are operated by users. In this example, the tablet terminalM functions as a master device which becomes a “parent” in the course ofthe progress of the game. The tablet terminal M executes the progress ofthe game and the display of the game image in association withoperations in the respective smartphones S1 to S4.

The tablet terminal M should desirably have a larger display screen thanthe smartphones S1 to S4, but the tablet terminal M may be a mobileterminal having the same configuration as the smartphones S1 to S4.

On the other hand, each of the smartphones S1 to S4 is a slave devicewhich becomes a “child”, and functions as a game controller which isoperated by each user. Each smartphone, S1 to S4, displays an image ofthe game controller on its display, and transmits, upon accepting a useroperation by an operation on the touch panel, a corresponding operationsignal to the tablet terminal M.

The tablet terminal M and smartphones S1 to S4 are connected to a Webserver apparatus SV over a network NW including the Internet, via anaccess point (AP) B1 or a nearby base station B2.

It is assumed that the functional hardware configuration of electroniccircuits, which are common to the tablet terminal M and smartphones S1to S4, is basically the same as that illustrated in FIG. 2. The partsnecessary in the description below are denoted by like referencenumerals, and the depiction and description of these parts are omitted.

It is also assumed that the hardware configuration of electric circuitsof the Web server apparatus SV is the same as a general configuration,and the depiction and description thereof are omitted.

Next, the operation of the second embodiment is described.

FIG. 14 is a sequence chart illustrating process contents as a whole,which are executed during a game between the Web server apparatus SVwhich comprehensively controls the entirety of the game, the tabletterminal M that is a master device and the smartphones S1 to S4 that areslave devices.

It is assumed that a game, which is executed in the present system, is,for example, a general card game, in which the plural smartphones S1 toS4 execute necessary operations by turns according to a preset order. Itis also assumed that the user of the smartphone, S1 to S4, which doesnot have its turn, merely views the condition of the game which isdisplayed on the tablet terminal M, and does not need to execute anyoperation.

The Web server apparatus SV during the game accepts reception of anoperation signal corresponding to the user's operation from thatterminal of the smartphones S1 to S4, which has its turn for anoperation (step S201), and repeatedly determines whether the receptionhas occurred (step S202), thereby standing by for the reception of anoperation signal from the terminal.

If it is determined that an operation signal has been received from theterminal of the smartphone, S1 to S4, which has its turn (Yes in stepS202), the Web server apparatus SV executes a progress process of thegame in accordance with the received operation signal (step S203),updates the data of a shared image for the tablet terminal M, andtransmits the updated data of the shared image to the tablet terminal M,thereby causing the tablet terminal M to display the shared image (stepS204).

The tablet terminal M always stands by for reception of an image fromthe Web server apparatus SV (step S301). At a time point when the imagehas been received, the tablet terminal M develops this image (step 302),and causes the display 18 to display the shared image (step S303). Then,the tablet terminal M returns to the process from step S301, thereby toreceive the next image.

At this time, the Web server apparatus SV creates a standby image andtransmits this standby image to the smartphones other than thesmartphone Sn (n: any one of 1 to 4) which requires an operation in thenext turn, and causes each smartphone to display the standby image (stepS205).

Further, the Web server apparatus SV executes, with respect to thesmartphone Sn (n: any one of 1 to 4) which requires an operation in thenext turn, correction setup for an operation element such as a button tobe operated, taking into account the history information of up to theprevious operation signal (step S206), and transmits the data of thecontroller image including the operation element such as a correctedbutton to the smartphone Sn (step S207). The Web server apparatus SVreturns to the process from step S201, thereby to respond to anoperation on the operation element such as a button in the controllerimage.

On the other hand, the smartphone, S1 to S4, always stands by forreception of an image from the Web server apparatus SV (step S401). At atime point when the image has been received, the smartphone, S1 to S4,develops the image (step S402), and determines whether the standby turncomes next, according to whether the developed image is an image whichdoes not require a corresponding operation (step S403).

If the standby turn is determined, the smartphone, S1 to S4, causes thedisplay 18 to display the developed standby image (step S404),temporarily disables an input by a touch operation or the like on thetouch panel input unit 19 to skip a useless input process, and returnsto the process from step S401, thereby to stand by for the next turn.

If the turn requiring an operation, and not the standby turn, isdetermined in step S403, the smartphone Sn displays on the display 18the received image data, that is, the controller image in which theposition, size, etc. of the operation element, such as the button or thelike, are customized based on the operation history thus far (stepS405), and stands by for an operation which is to be executed (stepS406).

Then, at a time point when an operation has been executed, based on asignal from the touch panel input unit 19, the smartphone Sn transmitsan operation signal corresponding to this operation to the Web serverapparatus SV (step S407), and returns to the process from step S401.

FIG. 15 is a view illustrating a case in which the states of, inparticular, the tablet terminal M and smartphones S1 and S2 during theexecution of the game are extracted and illustrated.

Part (A) of FIG. 15 illustrates a state in which the smartphone S1,which is operated by the user “Player A”, has its turn of operation. Inthis case, the tablet terminal M displays on the display 18 a guidemessage “Turn of player A”, and a shared image which is representativeof the conditions of the respective players corresponding to theprogress of the game at this time point.

On the other hand, the smartphone S1, which has its turn to requireexecution of an operation, displays, for example, a cross button B91 ona left end side of the screen in accordance with the controller imagewhich has been sent from the Web server apparatus SV. It is assumed thatthe user has operated a “right” side part of the button B91, asindicated by an arrow A91.

At this time, the smartphone S2, which does not have its turn, displaysan advertisement image WI1 as a standby image, which has beentransmitted from the Web server apparatus SV, and disables a touchoperation by the touch panel input unit 19.

Part (B) of FIG. 15 illustrates a state in which the operation by thesmartphone S1 was then finished and the smartphone S2, which is operatedby the user “Player B”, has its turn. In this case, the tablet terminalM displays on the display 18 a guide message “Turn of player B”, and ashared image which is representative of the conditions of the respectiveplayers corresponding to the progress of the game at this time point.

On the other hand, the smartphone S2, which has its turn to requireexecution of an operation, displays, for example, a cross button B92 ona left end side of the screen in accordance with the controller imagewhich has been sent from the Web server apparatus SV. It is assumed thatthe user has operated a “right” side part of the button B92, asindicated by an arrow A92.

At this time, the smartphone S1, which has already finished its turn,displays an advertisement image WI2 as a standby image, which has beentransmitted from the Web server apparatus SV, and disables a touchoperation by the touch panel input unit 19.

In the second embodiment, the description has been given of, by way ofexample, the case in which the terminal, which is other than theterminal that has its turn and which requires no operation on the game,is caused to display the advertisement image as the standby image.However, the present invention is not limited to this example, and it ispossible to display, for instance, some other mini-game, a tutorial, aguide manual of a game, etc.

As has been described above in detail, according to the secondembodiment, it is possible to realize an environment in which asmartphone or a tablet terminal, which is possessed by a general user,can be effectively used, and a game can be easily enjoyed, with apersonal habit in operation of each user being taken into account.

In addition, in the second embodiment, when a game on a rotating basis,such as a card game, is executed, a terminal device in a standby state,which is other than a terminal device that has its turn, is given animage which is not directly related to the game, such as anadvertisement image or an image of a game manual, as a standby image.Thereby, by making effective use of a system in which, unlike a closedsystem, images are provided by online from the Web server apparatus SW,it becomes possible to present various information, aside from the game,to the users, and to effectively use the standby time.

In each of the first and second embodiments, the case has been describedthat the game is performed by the tablet terminal M and, for example,four smartphones S1 to S4. However, if users participating in the gamehave at least information terminal devices having touch-panel-typedisplays, the same game environment can be realized, and there are norestrictions to the kinds of information terminal devices used by users,or the concrete contents of controller images.

The present invention is not limited to the above-described embodiments.In practice, various modifications may be made without departing fromthe spirit of the invention. In addition, the functions executed in theembodiments may be implemented by being properly combined as much aspossible. The above-described embodiments include inventions in variousstages, and various inventions can be derived from proper combinationsof structural elements disclosed herein. For example, even if somestructural elements in all the structural elements disclosed in theembodiments are omitted, if the advantageous effect can be obtained, thestructure without such structural elements can be derived as aninvention.

What is claimed is:
 1. A terminal display control method for using as acontroller of a game a terminal device including a touch panel which isconfigured to be integral with a display, comprising: selecting acontroller image which is used in the game; setting at least one of apresence/absence of a function, a number, a size, a shape and a positionof disposition, with respect to an operation element in the controllerimage; and making variable, in accordance with a content of the setting,a state of the controller image displayed on the display, and anoperation standard of the operation element corresponding to an input onthe touch panel.